Formal Performance Evaluation for Document Image Analysis

Document Image Analysis: Automated Performance Evaluation

Both users and developers of OCR systems benefit from objective performance evaluation and benchmarking. The need for improved tests has given additional impetus to research on evaluation methodology. We discuss some of the statistical and combinatorial principles underlying error estimation, propose a taxonomy for reference data, and review evaluation paradigms in current use. We provide point...

Performance evaluation for document analysis

A framework for evaluating the pefiormance of a document analysis system is presented. This framework takes into account the task definition for the document analysis system, a data base on which that system is evaluated, the rnetrics used toevaluate performance, and the generalization of the results achieved beyond the confines of the test. Several recent significant efforts in evaluating docu...

Performance Evaluation of Document Image Algorithms

A Performance Evaluation Methodology for Historical Document Image Binarization

Document image binarization is of great importance in the document image analysis and recognition pipeline since it affects further stages of the recognition process. The evaluation of a binarization method aids in studying its algorithmic behaviour and verifying its effectiveness by providing qualitative and quantitative indication of its performance. This work concerns a pixel-based binarizat...

Performance evaluation methodology for document image dewarping techniques

The performance evaluation of dewarping techniques is currently addressed by concentrating in visual pleasing impressions or by using optical character recognition (OCR) as a means for indirect evaluation. In this study, the authors present a performance evaluation methodology that calculates a comprehensive evaluation measure which reflects the entire performance of a dewarping technique in a ...